"Express Mail" Mailing Label No. EL960828054US 

PATENT APPLICATION 
ATTORNEY DOCKET NO. SUN03-0284-BBC 



10 METHOD AND APPARATUS FOR DETECTING 
MOTION-INDUCED ARTIFACTS IN VIDEO 

DISPLAYS 

Inventors: Eric Boucher and Joseph V. Miseh 



Related Application 

[0001] This application hereby claims priority under 35 U.S.C. §119 to 

20 U.S. Provisional Patent Application No. 60/504,1 16 filed on 18 September 2003, 
entitled "Motion Artifact Detection and Analysis Tool," by inventors Eric 
Boucher and Joseph V. Miseli (Attorney Docket No. SUN03-0284PSP), and to 
U.S. Provisional Patent Application No. 60/514,870 filed on 27 October 2003, 
entitled "Motion Artifact Detection and Analysis Tool," by inventors Eric 

25 Boucher and Joseph V. Miseli (Attorney Docket No. SUN03-0284PSP2). 



1 

Attorney Docket No. SUN03-0284-BBC Inventors: Boucher and Miseli 

DMG H:\SUN MICROS YSTEMS\SUN03-0284-BBC\SUN03-.0284-BBC APPLICATI0N.DOC 



BACKGROUND 



Field of the Invention 

[0002] The present invention relates to video displays. More specifically, 
the present invention relates to a method and an apparatus for detecting motion- 
induced artifacts on electronic display systems. 



Related Art 

[0003] Liquid Crystal Displays (LCDs) have considerably more difficulty 
10 than traditional Cathode Ray Tube (CRT) displays in accurately reproducing 

moving video images. In recent years, LCDs have advanced beyond CRTs in size 

and resolution, and are becoming comparable to CRTs in visual performance. 

During this time, visual performance issues, in which the LCDs lag the CRTs, 

have been addressed and have been improved significantly. However, until 
15 recently, the motion performance of LCDs has been considered, but only basic 

performance with regard to pixel response time and simple motion artifacts has 

been addressed. 

[0004] In determining the performance of LCD displays, many 

manufacturers qualify the product to assure that motion on the displays is within 
20 good engineering bounds. They may do simple image movement testing or 

response time testing to quantify it. To date, their assessment techniques and 

options are quite limited. 

[0005] Until other performance issues were addressed, motion 

performance issues for LCDs have generally been on the back burner. Now that 
25 these other performance issues have been controlled, it is time to deal with motion 

performance issues in LCDs. 
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[0006] Hence, what is needed is a method and an apparatus for testing 
motion performance in LCDs and other electronic display systems without the 
limitations listed above. 

SUMMARY 

[0007] One embodiment of the present invention provides a system that 
tests the motion performance of an electronic display system, wherein the 
electronic display system is comprised of a display, graphics processing software, 
graphics processing circuitry, and an interface coupling the display and the 
graphics processing circuitry. The system starts by receiving a request to measure 
an amount of distortion of an object in motion. In response to the request, the 
system measures the amount of distortion of the object in motion. 

[0008] In a variation on this embodiment, the system displays a second 
object and measures the distortion that occurs when the two objects interact. 

[0009] In a variation on this embodiment, the system receives a request to 
change a visual attribute of the object. In response to this request, the system 
changes the visual attribute of the object. 

[0010] In a further variation, the visual attribute can include color, size, 
shape, shading, fill pattern, speed, direction of movement, and type of movement. 

[0011] In a variation on this embodiment, measuring the amount of 
distortion of the object in motion involves placing a ruler on a boundary of the 
object where the distortion occurs, increasing the width of the ruler until it covers 
the distortion, and then measuring the width to determine the size of the 
distortion. 

[0012] In a further variation, the ruler is displayed every n^^ display cycle 
to minimize distortion of the ruler. 
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[0013] In a further variation, the width of the ruler is used to determine the 
response time of pixels in the display for any color or gray scale level. 

[0014] In a variation on this embodiment, the distortion can include 
flickering, flashing, smearing, bluring, line spreading, geometric distortion, color- 
5 induced artifacts, and inaccurate color reproduction. 

[0015] In a variation on this embodiment, the system stores the set of test 
parameters to a storage medium to facilitate producing an identical set of test 
parameters during a subsequent test. 

[0016] In a variation on this embodiment, the system records the measured 
10 distortion on a storage medium. Note that this facilitates in creating a benchmark 
and a report for a display system under test and provides information for 
characterizing the display performance over multiple test conditions. 

BRIEF DESCRIPTION OF THE FIGURES 
15 [0017] FIG. 1 illustrates a system that tests displays for motion artifacts in 

accordance with an embodiment of the present invention. 

[0018] FIG, 2 illustrates the structure of display-testing software in 
accordance with an embodiment of the present invention. 

[0019] FIG. 3 illustrates the geometry configuration portion of the display- 
20 testing GUI in accordance with an embodiment of the present invention. 

[0020] FIG. 4 illustrates the color configuration portion of the display- 
testing GUI in accordance with an embodiment of the present invention. 

[0021] FIG. 5 illustrates the measurements configuration portion of the 
display-testing GUI in accordance with an embodiment of the present invention. 
25 [0022] FIG. 6 presents a flow chart illustrating the process of testing a 

display for motion artifacts in accordance with an embodiment of the present 
invention. 
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[0023] FIG. 7 illustrates measuring a motion-induced artifact in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 
5 [0024] The following description is presented to enable any person skilled 

in the art to make and use the invention, and is provided in the context of a parti- 
cular application and its requirements. Various modifications to the disclosed 
embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
10 without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 
disclosed herein. 

[0025] The data structures and code described in this detailed description 
1 5 are typically stored on a computer readable storage medium, which may be any 
device or medium that can store code and/or data for use by a computer system. 
This includes, but is not limited to, magnetic and optical storage devices such as 
disk drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs 
or digital video discs), and computer instruction signals embodied in a 
20 transmission medium (with or without a carrier wave upon which the signals are 
modulated). For example, the transmission medium may include a 
communications network, such as the Intemet. 
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Display-testing for Motion Artifacts 

[0026] FIG. 1 illustrates a system for testing displays for motion artifacts 
in accordance with an embodiment of the present invention. The system 
illustrated in FIG. 1 comprises server 104 and client 108 which are coupled to 
5 network 100. Note that server 104 can generally include any computational node 
including a mechanism for servicing requests from a client for computational 
and/or data storage resources. Also, note that client 108 can generally include any 
node on a network including computational capability and including a mechanism 
for communicating across the network. Network 100 can generally include any 

10 type of wire or wireless communication channel capable of coupling together 

computing nodes. This includes, but is not limited to, a local area network, a wide 
area network, or a combination of networks. In one embodiment of the present 
invention, network 1 00 includes the Internet. 

[0027] Display 102 is the display that is being tested for motion artifacts. 

1 5 Note that the motion artifacts can be caused b^ any part of the display system, 
including graphics processing circuitry, the interface coupling the graphics 
processing circuitry to the display, and the display itself. Display 102 is coupled 
to server 104. Also coupled to server 104 is keyboard 105 and mouse 106. 
During the testing process, observer 1 12 may use GUI 1 10 on client 108 to 

20 manipulate objects on display 102 to test for motion induced artifacts. 
Additionally, observer 1 12 may use keyboard 105 and/or mouse 106 to 
manipulate objects on display 102. 

Display-testing Software 
25 [0028] FIG. 2 illustrates the structure of display-testing software in 

accordance with an embodiment of the present invention. In one embodiment of 
the present invention, this software is known as the Motion Artifact Detection and 
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Analysis Tool (MAD AT). In this embodiment, MAD AT is installed on server 
104, and is comprised of engine 200, as well as various support modules. These 
modules can include, network interface module 201, timer control module 202, 
object control module 204, color control module 206, analysis module 208, 
5 overlay engine module 210, file manipulation module 2 1 2, miscellaneous module 
214, and display module 216. 

[0029] Network interface module 201 allows engine 200 to communicate 
with GUI 110. Note that GUI 1 10 can exist on any machine coupled to network 
100, or even on server 104 itself. 

10 [0030] Overlay engine module 210 allows two objects to be controlled 

simultaneously in order to test the interaction of two moving objects. Overlay 
engine module 210 is comprised of an almost identical set of components as the 
MAD AT software itself For instance, within overlay engine module 210, you 
will find a timer control, an object control, and a color control. 

1 5 [0031] Display module 2 1 6 takes input from timer control module 202, 

object control module 204, color control module 206 and overlay engine module 
210, and uses these inputs to determine a set of graphical images to output to 
display 102, which is the display under test. 

20 GUI - Geometry Configuration 

[0032] FIG. 3 illustrates the geometry configuration portion of GUI 1 10 in 
accordance with an embodiment of the present invention. GUI 110 allows 
observer 1 12 to set various attributes related to the geometry of the object being 
used to test display 102. These attributes can include oscillation, angle, line 

25 attributes, location, dimensions, and shape. Note that in addition to GUI 1 10, 
observer 112 may use the command-line interface with keyboard 105 to 
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implement all of the functionality accessible via GUI 110. The command-line 
interface offers additional speed, compactness, and flexibility. 

[0033] GUI 1 10 allows observer 1 12 to take control of virtually every 
aspect of the visual environment of display 102. Observer 1 12 may select from a 
5 set of pre-define objects, as well as importing a custom object. In addition, 

observer 1 12 may select two objects to additionally test for artifacts caused by the 
interaction of the two objects. 

[0034] In one embodiment of the present invention, observer 1 12 may set 
the motion type of the object to linear, linear oscillation, or sinusoidal oscillation, 
10 During sinusoidal oscillation, the object moves the fastest through the center of 
oscillation, and the slowest at the end points. In the instances where oscillation is 
chosen, observer 1 12 can choose the width and the frequency of oscillation. 

[0035] Additionally, observer 112 can change the direction of motion as 
well as the speed. In one embodiment of the present invention, speed is referred 
15 to as pixels per refresh, or simply the number of pixels the object moves on the 
display for each refresh cycle of the display. Since the display size and refresh 
rate is known to the program, speed can also be expressed in various other terms, 
such as inches per second. 

[0036] In one embodiment of the present invention, observer 1 12 may use 
20 GUI 110, as well as clicking and dragging portions of the object itself to alter the 
object's geometry. 



GUI - Color Configuration 

[0037] FIG. 4 illustrates the color configuration portion of GUI 1 10 in 
25 accordance with an embodiment of the present invention. GUI 110 allows 

observer 1 12 to set various attributes related to the color of the object being used 
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to test display 102. These attributes can include line colors, foreground colors, 
background colors, and gradient shading. 

[0038] Note that it is important to consider color when testing a display 
for motion-produced artifacts. Since pixels on a display may exhibit different 
5 response times to turn on or off for different colors, distortions may not be 

noticeable for one set of colors, but may be extremely noticeable with another set 
of colors. 

GUI - Measurement Configuration 

10 [0039] FIG. 5 illustrates the measurements configuration portion of GUI 

1 10 in accordance with an embodiment of the present invention. GUI 110 allows 
observer 1 12 to set various attributes related to the measuring of the artifacts 
produced on display 102. These attributes can include the types of measurement 
rulers, the colors of the rulers, and the deltas of the rulers. 

15 [0040] When observer 1 12 notices an artifact or distortion, observer 1 12 

may choose to measure the distortion by displaying rulers along with the object 
that is being distorted. In one embodiment of the present invention, one ruler is 
placed along the leading edge of the moving object, and another ruler is placed on 
the trailing edge. The rules may be widened, represented by the delta value, to 

20 cover the area of the distortion. Once the ruler covers the distortion completely, 
the delta value indicates the amount of distortion caused by the moving object 
with a specific set of visual attributes. The delta value can then be used to 
compute the response times for the pixels under the given visual attributes. Note 
that the ruler on the leading edge measures the response time for the pixels to turn 

25 on, while the trailing edge ruler measures the response time for the pixels to turn 
off. Note that rulers can be any shape or size including, but not limited to, lines. 
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shapes, background images, and multiple lines. Also note that the rulers may be 
oriented in any direction and attached to any portion of the artifact. 

[0041] In one embodiment of the present invention, the rulers may be 
displayed at every n refresh cycles of display 102. This allows for greater 
accuracy in measuring the distortion by minimizing motion artifacts caused by the 
rulers moving. 

Testing Displays for Motion Artifacts 

[0042] FIG. 6 presents a flow chart illustrating the process of testing a 
10 display for motion artifacts in accordance with an embodiment of the present 
invention. A video image is generated which shows an object moving across 
display 102 in time. An ideal display will produce the object precisely, with no 
temporal degradation. Display 102 may have latency, response time limitations, 
real time processing (timing) difficulties, real-time color rendering delays, and a 
15 host of other temporal processing inaccuracies which may contribute to 

reproducing the content with distortions, or artifacts. The moving object may be 
visible on display 102 producing artifacts of various types, including flickering, 
flashing, smearing, distorting, producing inaccurate colors, etc. These are all 
undesired temporal distortions. Ideally, the object should look exactly the same to 
20 observer 1 12 while the object is in motion and while the object is still. In 

addition, the object should look the same over time and be free from temporal 
distortions that are not motion-induced. 

[0043] The distortion in such a case can be easily observed. However, the 
characteristics of the human visual system can contribute to some perceptions of 
25 distortion that may not actually be generated on display 102. It is a major part of 
this program to provide enough tools and control to help definitively assess the 
motion distortion using other than the eye of observer 112. 
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[0044] The system starts by producing an image (step 602) and displaying 
the image on display 102 (step 604). Note that the image can include a pre- 
defined image such as a line, a hollow box, a filled box, a hollow ellipse, a filled 
ellipse, a hollow triangle, a filled triangle, random line patterns, or a custom 
5 image that observer 112 imports. Note that different images can produce different 
types of motion-induced artifacts. Observer 1 12 views the image (step 606) and 
manipulates the controls that produce the image via GUI 1 10, and or keyboard 
105 and mouse 106, (step 608). As the image controls are manipulated, the 
system repeats steps 602 through 608. Upon discovering a noticeable artifact, the 

10 system may analyze the image (step 610), or provide adequate control for 
subjective determination of the artifact by observer 112. 

[0045] Note that the motion artifacts can be caused by any part or on any 
part of the display system. For example, in one embodiment of the present 
invention, artifacts may be observed that are the result of poor response time for 

1 5 pixels within an LCD display. Artifacts may also result from a flaw in the 
graphics processing circuitry or the software that generates the images for the 
display. Furthermore, artifacts may be observed that are the result of 
characteristics on the transmission lines between the graphics processor and the 
display such as cross-talk, amplitude dependencies, and skew. 

20 

Measuring a Motion-Induced Artifact 

[0046] FIG. 7 illustrates measuring a motion-induced artifact in 
accordance with an embodiment of the present invention. Analysis of the image 
is a combination of the subjective, which requires the input of observer 1 12, and 
25 numerical analysis which is done by the system itself. Due to the dynamic nature 
of the system, observer 1 12 is able to constantly manipulate the attributes of the 
display system to detect and quantify any number of visual artifacts. In some 
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instances, artifacts might be easily detectable but difficult to quantify, such as 
flickering of the object. In these cases, the system facilitates in producing artifacts 
so that subjective analysis and reporting can begin. 

[0047] One type of numerical analysis is performed by creating guides or 
5 rules along portions of the object being displayed. In one embodiment, one ruler 
(ruler 702) is created on the leading edge of moving object 700, and another ruler 
(ruler 704) is created on the trailing edge. By altering a delta value for each ruler, 
the width of the rulers can be changed to completely cover the area of distortion 
on each of the edges of the object. For instance, the delta value can be changed 

10 for ruler 702 until it completely covers artifact 706, and the delta value for ruler 
704 can be changed until it completely covers artifact 708. Theoretically, the 
delta should remain at zero, even while object 700 is in motion. However, as 
motion is introduced and the various attributes of object 700 are modified, it is 
possible to measure the differences as the distortion occurs. This aids in 

15 quantifying the distortion in addition to describing the distortion. 

[0048] The delta of leading edge ruler 702 can be used to quantify the 
response time for the pixels to turn on for the given set of visual attributes. 
Likev\dse, the delta of trailing edge ruler 704 can be used to quantify the response 
time for the pixels to turn off for the given set of visual attributes. Note that it 

20 may be important for the rulers 702 and 704 to be displayed every n^^ refresh cycle 
so that distortion of the rulers in motion does not come into play. 

[0049] The foregoing descriptions of embodiments of the present 
invention have been presented for purposes of illustration and description only. 
They are not intended to be exhaustive or to limit the present invention to the 

25 forms disclosed. Accordingly, many modifications and variations will be apparent 
to practitioners skilled in the art. Additionally, the above disclosure is not 
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intended to limit the present invention. The scope of the present invention is 
defined by the appended claims. 
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